Ultrasound image processing apparatus and medium

ABSTRACT

An ultrasound image processing apparatus includes a structural object extracting unit, an abnormal candidate spot detecting unit and a cine information generating unit. The structural object extracting unit extracts a structural object in an ultrasound image of each frame from ultrasound image data of a plurality of continuous frames. The abnormal candidate spot detecting unit detects an abnormal candidate spot in the extracted structural object. The cine information generating unit generates cine information where the detected abnormal candidate spot is made to be associated with a frame in which the abnormal candidate spot is detected.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an ultrasound image processingapparatus and a medium.

2. Description of Related Art

In ultrasound diagnosis, beating of a heart and movement of a fetus canbe obtained as ultrasound images with simple operation of applying anultrasound probe on body surface. Ultrasound diagnostic imagingapparatuses used for performing such ultrasound diagnosis are known. Anultrasound image is obtained by an ultrasound probe sending ultrasoundwaves inside a subject, the ultrasound probe receiving reflectedultrasound waves and performing various processes to the receivedsignals.

In an ultrasound diagnostic apparatus, real time inside image of aliving body can be displayed during examination by continuouslydisplaying one frame of ultrasound image data one after another inchronological order, each frame of ultrasound image data being generatedby ultrasound waves being sent and received. Further, video data (cinevideo data) formed of a plurality of frames of ultrasound image data canbe stored, and such data can be replayed after examination.

For example, when making a diagnosis on mammary gland, a reader (atechnician or a physician) may replay the cine video data which isobtained by an examiner (a technician or a physician) with an ultrasounddiagnostic apparatus to read the images (video) after examination. Insuch case, the examiner checks the time until an abnormal candidate isshown since the start of examination when registering the data and tellsthe reader about the time.

As a method to eliminate images unnecessary for making diagnosis and toefficiently search for an images when reading the data afterexamination, there is known a method provided in an ultrasounddiagnostic apparatus where, with respect to replaying a plurality offrames of ultrasound image data, at least one of start and end ofultrasound image data recording is controlled with a predetermined eventwhich is registered in advance being the trigger, the predeterminedevent is recorded as an attachment information to the ultrasound imagedata and desired ultrasound image data is searched for on the basis ofthe attachment information (see JP 2006-141997). The predetermined eventis a button operation such as image adjustment operation, change inbrightness for a threshold or more between frames when generating acontrast image, etc.

Further, there is known an ultrasound diagnostic apparatus in whichultrasound image data in chronological order is collected, an extractioncondition for extracting a predetermined ultrasound image data isstored, ultrasound image data corresponding to the time period when twoor more setting items satisfy the extraction condition is extracted (seeJP 2014-176430). The extraction condition is an event in connection withan operation, an image quality parameter, collection condition (framerate, scan range, raw data), a diagnostic condition (Exam Type), etc.

In the case where an examiner orally tells a reader about an abnormalcandidate spot, the examiner has to visually recognize the abnormalcandidate spot, record a plurality of continuous frames of ultrasoundimage data so as to include the abnormal candidate spot and remember thetime until the abnormal candidate spot is shown since start of imagedata recording. Thus, a great burden is put on the examiner. In the casewhere ultrasound image data is searched for in association with exist ornon-exist of a predetermined event which is registered in advance or inthe case where the extraction condition for extracting a predeterminedultrasound image data is stored and the ultrasound image datacorresponding to the time period when the extraction condition issatisfied is extracted, the predetermined event which is registered inadvance and the extraction condition may not necessarily match theultrasound image data in which the abnormal candidate spot exits.

SUMMARY OF THE INVENTION

An object of the present invention is to easily recognize where in theplurality of continuous frames of ultrasound image data is the frame inwhich an abnormal candidate spot exists.

To achieve the object described above, according to one aspect of thepresent invention, there is provided an ultrasound image processingapparatus according to one aspect of the present invention, including: astructural object extracting unit which extracts a structural object inan ultrasound image of each frame from ultrasound image data of aplurality of continuous frames; an abnormal candidate spot detectingunit which detects an abnormal candidate spot in the extractedstructural object; and a cine information generating unit whichgenerates cine information where the detected abnormal candidate spot ismade to be associated with a frame in which the abnormal candidate spotis detected.

Preferably, the ultrasound image processing apparatus further includes:a cine slider generating unit which generates a cine slider whichreceives an operation to slide and display the plurality of frames ofultrasound image data by arranging a first marker informationcorresponding to a type of the abnormal candidate spot in the generatedcine information at a position of the frame in which the abnormalcandidate spot is detected; and a display controller which makes theplurality of frames of ultrasound image data be displayed in a displaywith the generated cine slider.

Preferably, in the ultrasound image processing apparatus, in a casewhere a plurality of continuous frames relating to a same type ofabnormal candidate spot exist in the plurality of frames of ultrasoundimage data, the cine slider generating unit generates the cine slider byarranging a second marker information which indicates a region of theplurality of frames relating to the same type of abnormal candidate spotin the generated cine information at a position of the region of theabnormal candidate spot.

Preferably, in the ultrasound image processing apparatus, the cineslider generating unit generates the cine slider by setting one framefor displaying the first marker information corresponding to the type ofabnormal candidate spot in the region relating to the same type ofabnormal candidate spot and by arranging the first marker information ata position of the set frame.

Preferably, in the ultrasound image processing apparatus, the cineslider generating unit generates the cine slider by setting differentcolors according to types of abnormal candidate spot to display thefirst marker information and/or the region relating to the same type ofabnormal candidate spot.

Preferably, in the ultrasound image processing apparatus, the cineinformation generating unit generates the cine information includingoperating information where a type of operation performed whengenerating the plurality of frames of ultrasound image data is made tobe associated with a frame which is subject to the operation.

Preferably, in the ultrasound image processing apparatus, the cineinformation generating unit generates the cine information includingoperating information where a type of operation performed whengenerating the plurality of frames of ultrasound image data is made tobe associated with a frame which is subject to the operation, and thecine slider generating unit generates the cine slider by arranging athird marker information corresponding to the type of operation in thegenerated cine information at a position of a frame which is subject tothe operation.

Preferably, the ultrasound image processing apparatus further includes:a transmitting unit which transmits a driving signal to an ultrasoundprove which transmits and receives ultrasound waves to and from asubject; a receiving unit which receives a received signal from theultrasound probe; and an image generating unit which sequentiallygenerates the plurality of frames of image data from the receivedsignal.

According to a second aspect of the present invention, there is provideda computer readable non-transitory medium which realizes a program tomake a computer function as: a structural object extraction unit whichextracts a structural object in an ultrasound image of each frame fromultrasound image data of a plurality of continuous frames; an abnormalcandidate spot detecting unit which detects an abnormal candidate spotin the extracted structural object; and a cine information generatingunit which generates cine information where the detected abnormalcandidate spot is made to be associated with a frame in which theabnormal candidate spot is detected.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will become more fully understood from thedetailed description given hereinbelow and the appended drawings whichare given by way of illustration only, and thus are not intended as adefinition of the limits of the present invention, and wherein:

FIG. 1 is an outer image of an ultrasound diagnostic imaging apparatusaccording to an embodiment of the present invention;

FIG. 2 is a block diagram showing a functional configuration of theultrasound diagnostic imaging apparatus;

FIG. 3 is a flowchart showing a first cine screen information displayprocess;

FIG. 4 is a flowchart showing the cine information generation process inthe first cine screen information display process;

FIG. 5 is a conceptual image used for explaining an example ofdiscriminating method used for tumor discrimination;

FIG. 6 is a flowchart showing the cine slider generation process in thefirst cine screen information display process;

FIG. 7 is a cine screen;

FIG. 8 is a flowchart showing a second cine image information displayprocess;

FIG. 9 is a block diagram showing a modification example of anultrasound diagnostic imaging system; and

FIG. 10 is a flowchart showing a third cine screen information displayprocess.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

An embodiment and a modification example of the present invention willbe described in details with reference to the attached drawings.However, the present invention is not limited to the examples shown inthe drawings. In the following description, the same reference numbersare used for the same functions and compositions, and their descriptionsare omitted.

Embodiment

With reference to FIGS. 1 to 8, an embodiment will be described. First,with reference to FIG. 1, the overall configuration of the ultrasounddiagnostic imaging apparatus 100 as an ultrasound image processingapparatus of the embodiment will be described. FIG. 1 is an outer imageof the ultrasound diagnostic imaging apparatus according to theembodiment.

As shown in FIG. 1, the ultrasound diagnostic imaging apparatus 100includes an ultrasound diagnostic imaging apparatus main body 1 and anultrasound probe 2. The ultrasound probe 2 transmits ultrasound waves(transmission ultrasound waves) in to a subject such as a living body(not shown) and at the same time, receives reflected ultrasound waves(reflected ultrasound waves: echo) reflected off inside the subject. Theultrasound diagnostic imaging apparatus main body 1 is connected withthe ultrasound probe 2 via a cable 3. The ultrasound diagnostic imagingapparatus main body 1 transmits driving signals which are electricalsignals to the ultrasound probe 2 to make the ultrasound probe 2transmit transmission ultrasound waves to a subject and at the sametime, visualizes the internal state of the subject as an ultrasoundimage on the basis of the received signals which are electrical signalsgenerated in the ultrasound probe 2 in accordance with the reflectedultrasound waves from inside the subject received by the ultrasoundprobe 2.

The ultrasound probe 2 is provided with transducers 2 a (see FIG. 2)which are formed of piezoelectric elements. In the ultrasound probe 2, aplurality of transducers 2 a are arranged in the manner of onedimensional array in the orientation direction (scanning direction), forexample. In the embodiment, for example, an ultrasound probe 2 providedwith 192 transducers 2 a is used. Here, the transducers 2 a may bearranged in the manner of two dimensional array. Further, the number ofthe transducers 2 a may be set arbitrarily. In the embodiment, a linearelectronic scanning probe is used as the ultrasound probe 2 andultrasound scanning of linear scanning method is performed. However, anyscanning method such as a sector scanning method, a convex scanningmethod, etc. can be applied. Communication between the ultrasounddiagnostic imaging apparatus main body 1 and the ultrasound probe 2 canbe carried out by wireless communication such as by using UWB (UltraWide Band), etc. instead of wired communication via the cable 3.

Next, with reference to FIG. 2, a functional configuration of theultrasound diagnostic imaging apparatus 100 will be described. FIG. 2 isa block diagram showing a functional configuration of the ultrasounddiagnostic imaging apparatus 100.

As shown in FIG. 2, the ultrasound diagnostic imaging apparatus mainbody 1 includes an operation input unit 11, a transmitting unit 12, areceiving unit 13, an image generating unit 14, a cine informationgenerating unit 15 as a structural object extracting unit and anabnormality candidate detecting unit, a cine storage unit 16, a cinemarker storage unit 17, a cine slider generating unit 18, a displaycomposite unit 19 as a display controller, a display 20 and a controller21.

The operation input unit 11, for example, includes various types ofswitches, buttons, a track ball, a mouse, a keyboard, etc. in order toinput a command to instruct staring of diagnosis, data such as personalinformation of a subject, various types of parameters for displaying anultrasound image in the display 20, etc. The operation input unit 11further outputs operation signals to the controller 21. In particular,the operation input unit 11 includes a freeze button which receives aninput relating to freezing of an ultrasound image in a video which isbeing played and input relating to ending of generation of cine videodata.

The transmitting unit 12 is a circuit to make the ultrasound probe 2generate transmission ultrasound waves by supplying a driving signalwhich is an electrical signal to the ultrasound probe 2 via the cable 3in accordance with the control of the controller 21. The transmittingunit 12 includes a clock generating circuit, a delay circuit and a pulsegenerating circuit, for example. The clock generating circuit is acircuit for generating a transmission timing of a driving signal and aclock signal which decides the transmission frequency. The delay circuitis a circuit for setting a delay time for each of the individual pathscorresponding to the transducers 2 a and for focusing transmission beams(transmission beam forming) which is formed of transmission ultrasoundwaves by delaying the transmission of driving signals for the set delaytimes. The pulse generating circuit is a circuit for generating pulsesignals as the driving signals at a predetermined cycle. Thetransmitting unit 12 having the configuration as described abovesequentially switches the transducers 2 a to which the driving signalsare to be supplied by shifting the transducers 2 a by a predeterminednumber of transducers 2 a in each transmission and reception ofultrasound waves and carries out scanning by supplying driving signalsto the plurality of transducers 2 a which are selected to outputultrasound waves in accordance with the control of the controller 21.

The receiving unit 13 is a circuit which receives received signals whichare electrical signals via the cable 3 from the ultrasound probe 2 inaccordance with the control of the controller 21. The receiving unit 13includes an amplifier, an A/D converting circuit and a phase additioncircuit, for example. The amplifier is a circuit for amplifying thereceived signals at a pre-set amplifying rate for individual pathscorresponding to individual transducers 2 a. The A/D conversion circuitis a circuit for performing the analog-digital conversion (A/Dconversion) on the amplified received signals. The phase additioncircuit is a circuit which adjusts the time phases of the receivedsignals which went through the A/D conversion by providing each pathcorresponding to each transducer 2 a with delay time and generate soundray data by adding them (phase addition). That is, the phase additioncircuit generates sound ray data by carrying out received beam formingwith respect to the received signals of individual transducers 2 a.

The image generating unit 14 carries out the envelope detector process,logarithmic compression and the like on the sound ray data from thereceiving unit 13 and performs brightness conversion by adjusting thedynamic range and gain. Thereby, the image generating unit 14 generatesB (brightness) mode image data. That is, B mode image data expresses thestrength of received signals in terms of brightness.

The image generating unit 14 includes an image memory unit (not shown inthe drawings) which is formed of a semiconductor memory such as a DRAM(Dynamic Random Access Memory). The image generating unit 14 stores thegenerated B mode image data in the image memory unit in frame units.Image data in frame units may be called ultrasound image data or frameimage data.

The image generating unit 14 further performs image processes such as animage filter process, a time smoothing process and the like, as needed,on the ultrasound image data which is read out from the image memoryunit as needed and then, the ultrasound image data which went throughsuch image processes is subject to scan conversion into display imagepattern so as to be displayed in the display 20. The image generatingunit 14 outputs the generated ultrasound image data to the cineinformation generating unit 15 and the cine storage unit 16 as cinevideo data, and outputs the ultrasound image data to the displaycomposite unit 19 for real time (live) ultrasound image display.

The cine information generating unit 15 determines whether an abnormalcandidate spot such as a lesion exists with respect to each frame ofcine video data which is generated in the image generating unit 14.Then, the cine information generating unit 15 generates cine informationcorresponding to the frame in which an abnormality candidate spot existsamong the frames of cine video data and outputs the generated cineinformation to the cine storage unit 16.

The cine storage unit 16 is formed of a semiconductor memory such as aflash memory, an EEPROM (Electrically Erasable Programmable ROM) or thelike, for example. The cine video data which is generated in the imagegenerating unit 14 and the cine information generated in the cineinformation generating unit 15 are stored in the cine storage unit 16.

The cine marker storage unit 17 is formed of a semiconductor memory suchas a flash memory, an EEPROM, a ROM or the like, for example. Markerinformation for displaying a marker according to the type of abnormalcandidate spot such as a lesion and an abnormal candidate regionindicating the region of continuous cine frames relating to an abnormalcandidate spot in cine video data is stored in the cine marker storageunit 17. Marker information is made to be associated with a cine markernumber which identifies the type of cine marker (marker, abnormalcandidate spot).

The cine slider generating unit 18 generates a cine slider on the basisof the cine information and the cine video data which are read out fromthe cine storage unit 16 and the marker information which is read outfrom the cine marker storage unit 17. Normally, at the time when thecine video data is replayed, the cine slider indicates the replay statussuch as which frame is currently being replayed. However, the cineslider which is generated in the cine slider generating unit 18 canfurther indicate in which frame, counting from the first frame, anabnormal candidate spot exists. Furthermore, the cine slider generatingunit 18 outputs the cine information which is read out from the cinestorage unit 16 to the display composite unit 19.

The display composite unit 19 composites the cine video data which isinput from the cine slider generating unit 18 and the cine slider, andoutputs the composition of the cine video data and the cine slider tothe display 20 as cine screen information.

As for the display 20, any of the display apparatuses such as a LCD(Liquid Crystal Display), a CRT (Cathode-Ray Tube) display, an organicEL (Electronic Luminescence) display, an inorganic EL display, a plasmadisplay and the like can be applied. The display 20 displays cinescreens or ultrasound images in the display screen in accordance withimage signals of the cine screen information or the ultrasound imagedata which is output from the display composite unit 19.

The controller 21 includes a CPU (Central Processing Unit), a ROM (ReadOnly Memory) and a RAM (Random Access Memory), for example. Thecontroller 21 reads out a process program among various types ofprograms such as the system program and the like stored in the ROM andopens the program in the RAM. In accordance with the opened program, thecontroller 21 performs centralized controlling of the operation of eachcomponent of the ultrasound diagnostic imaging apparatus main body 1.The ROM is formed of a non-volatile memory such as a semiconductor, forexample. A system program corresponding to the ultrasound diagnosticimaging apparatus 100, various types of process programs which can beexecuted on the system program and various types of data such as gammatable and the like are stored in the ROM. These programs are stored inthe form of computer readable program codes. The CPU sequentiallyexecutes operation in accordance with the program codes. The RAM forms awork area in which various types of programs which are to be executed bythe CPU and data according to the programs are temporarily stored. Inparticular, it is assumed that the first and second cine screeninformation display programs are stored in the ROM of the controller 21.Here, although the controller 21 controls the individual components ofthe ultrasound diagnostic imaging apparatus main body 1, lines thatexpress such controlling are omitted in FIG. 2.

With respect to the transmitting unit 12, the receiving unit 13, theimage generating unit 14, the cine information generating unit 15, thecine slider generating unit 18, the display composite unit 19 and thecontroller 21 included in the ultrasound diagnostic imaging apparatus100, a part of or all of the functions of each function block can berealized as a hardware circuit such as an integrated circuit. Integratedcircuit is LSI (Large Scale Integration), for example, and is alsocalled as IC, system LSI, super LSI or ultra LSI according to the levelof integration of the LSI. The method to form an integrated circuit isnot limited to LSI and can be realized by an exclusive circuit or anall-purpose processor. Alternatively, an FPGA (Field Programmable GateArray) or a reconfigurable processor can be utilized which canreconfigure the connection and setting of circuits in the LSI. Further,a part of or all of the functions of each function block can be executedby software. In such case, such software is stored in one or a pluralityof recording medium such as a ROM, an optical disk, a hard disk and thelike. The software is executed by an arithmetic processor.

Next, operation of the ultrasound diagnostic imaging apparatus 100 willbe described with reference to FIGS. 3 to 8. In particular, the firstand second cine screen information display processes which are executedby the controller 21 will be described. FIG. 3 is a flowchart showingthe first cine screen information display process. FIG. 4 is a flowchartshowing the cine information generation process in the first cine screeninformation display process. FIG. 5 is a conceptual image used forexplaining an example of discrimination method used to discriminate atumor. FIG. 6 is a flowchart showing the cine slider generation processin the first cine screen information display process. FIG. 7 is the cinescreen 200. FIG. 8 is a flowchart showing the second cine screeninformation display process.

The first cine screen information display process is a process togenerate cine video data which is obtained by transmitting and receivingultrasound waves, to detect an abnormal candidate spot such as a lesionin a cine frame of the generated cine video data, and to display thecine video data with the cine slider which indicates the cine frame inwhich the abnormal candidate spot exits.

For example, input of an instruction to execute the first cine screeninformation display process performed by an examiner (technician orphysician) of a subject via the operation input unit 11 being thetrigger, the controller 21 controls the individual components inaccordance with the first cine screen information display program storedin the ROM to execute the first cine screen information display process.

As shown in FIG. 3, first, the transmitting unit 12 and the receivingunit 13 perform transmitting and receiving of ultrasound waves for oneframe of ultrasound image via the ultrasound probe 2 (step S11). Next,the image generating unit 14 generates one cine frame (one frame ofultrasound image data) corresponding to the transmitting and receivingof ultrasound waves in step S11, outputs the generated one cine frame tothe cine information generating unit 15, cine storage unit 16 anddisplay composite unit 19, and stores the cine frame as one frame ofcine video data in the cine storage unit 16 (step S12). The cine framewhich is input in the display composite unit 19 is displayed in thedisplay 20 as real time (live) screen information.

Then, the cine information generating unit 15 executes the cineinformation generation process (step S13). Here, the cine informationgeneration process of step S13 will be described with reference to FIG.4. First, the cine information generating unit 15 performs preprocessingsuch as a dynamic range adjusting, smoothing process and the like on theone cine frame which is generated in step S12 (step S21).

Then, the cine information generating unit 15 performs an arithmetic ofa predetermined feature quantity with respect to the cine frame to whichthe preprocessing is performed in step S21. Thereafter, the cineinformation generating unit 15 extracts a structural object in the imageby a predetermined determination method according to the arithmeticresult (step S22).

As for the predetermined feature quantity mentioned in step S22, featurequantity of Hessian analysis, HaarLike feature quantity, LBP (LocalBinary Pattern) or the like is used. Hessian analysis is an analysismethod by which a cylindrical structure, planar structure, massstructure, noise and the like are estimated by analyzing an eigen valueas a feature quantity from the second derivative component informationon an XYZ space (=Hessian matrix). In the X-Y scape of an image, as inthe embodiment, a linear structure and a mass structure can be estimated(“Multiscale vessel enfancement filtering” Alejandoro F Flangi et al.1998, MICCAI).

HaarLike feature quantity is a value (regional contrast) where the sumof pixel values in a white region is subtracted from the sum of pixelvalues in a black region in a rectangle (HaarLike pattern) which is thecalculation target in the search window in an image. HaarLike featurequantity is used to determine the detection target (here, a structuralobject) in the search window by changing the position and size of theHaarLike pattern in the search window and comparing with the contrast ina learning sample.

LBP is an extraction method of a regional feature in an image and asimilar image (detection target) can be searched for. Bit output isperformed after comparing the value of the target pixel to the values ofthe surrounding pixels starting from the upper left of the target pixeland going around in the clock-wise direction (the target pixel value orgreater: 1, smaller than the target pixel value: 0), and the 8-bit valueobtained by arranging the bits in a line is used as the LBP featurequantity.

The predetermined method in step S22 is a threshold treatment, acorrelation value judgment, a discriminant analysis, a SVM (SupportVector Machine) or the like. Threshold treatment is a method todetermine whether an image is the detection target on the basis ofwhether the feature quantity of the image is equal to or greater than apredetermined threshold.

Correlation value judgment is a method to determine whether an image isthe detection target on the basis of the level of correlation of thefeature quantity of the image to the feature quantity of the detectiontarget.

Discriminant analysis is a method to determine whether an image is thedetection target by setting feature quantities at a plurality of axisand by judging where the feature quantity which is detected in theanalysis target image is found.

SVM is a method to determine whether an image is the detection target bycalculating an identification surface which suitably separates thetraining data of positive and negative examples in a feature space (forexample, so as to maximize the margin). Whether an image is thedetection target is determined on the basis of in which area the featurequantity of the image is included with the identification surface beingthe border.

The threshold, discriminant, identification surface or the like in theabove described predetermined determination method can be set by MachineLearning. Machine Learning is one of search themes in the area ofartificial intelligence, and is a technique that tries to realize thefunction same as the learning ability that is naturally realized byhuman in computer. In machine learning, a plurality of sample data isobtained for each category, categories being identified in advance, anda discrimination criterion is prepared on the basis of the sample data.As for the algorithm of machine learning, random forest is known. RandomForest is a model using a group learning in which the decision tree isused as the weak learner (a learner of low accuracy). For example, datawhich is obtained through performing sampling on teacher data is givento a node and a number of tree structure graphs (decision tree) areprepared to discriminate data by using a number of decision trees.

The cine information generating unit 15 performs a predetermined featurequantity arithmetic with respect to the image of the structural objectwhich is extracted in step S22 and detects an abnormal candidate spot inthe structural object by a predetermined determination method accordingto the arithmetic result (step S23). As for the predetermined featurequantity and determination method in step S23, the feature quantity anddetermination method described in step S22 are used. In the embodimentan example where the target to be detected as an abnormal candidate spotis a tumor will be described hereinafter. If the abnormal candidate spotis a tumor, the tumor is detected as a mass structural object by Hessiananalysis or the like, for example. The roundness of the mass structuralobject and the average of brightness values of the pixels included inthe mass structure are calculated.

FIG. 5 is a conceptual image used for explaining the discriminationmethod used for tumor discrimination. For example, a case where a graphof two feature quantities in which the vertical axis shows averagevalues of brightness values and the horizontal axis shows the roundnessis set and whether a structural object is a tumor as the detectiontarget is determined will be considered. As shown in FIG. 5, teacherdata indicating the feature quantities of the structural object which isa tumor and the structural object which is not a tumor is input in thefeature quantity graph in advance, and a discriminant which is theborder between the tumor region and the non-tumor region is prepared.Then, in step S23, whether the structural object which is extracted instep S22 is a tumor is determined on the basis of in which region thefeature quantity of the structural object which is extracted in step S22is included with the discriminant being the border. If the structuralobject is a tumor, the abnormal type (tumor) of the abnormal candidatespot is specified.

Then, the cine information generating unit 15 makes the abnormality typeof the abnormal candidate spot which is detected in step S23 and theframe number of the cine frame in which the abnormal candidate spot isdetected be associated with each other (step S24). Frame number is theidentification information of each cine frame in the cine video data andthe cine frames are numbered in the order of generation in the imagegenerating unit 14. The cine information generating unit 15 updates thecine information so as to include the frame number (abnormal candidatespot number) of the cine frame in which the abnormal candidate spot isdetected which is made to be associated with the abnormality type of theabnormal candidate spot in step S24, stores the updated cine informationin the cine storage unit 16 (step S25) and ends the cine informationgeneration process.

Returning to FIG. 3, the cine information generating unit 15 determineswhether an examiner operates on the freeze button in the operation inputunit 11 (step S14). If the freeze button is not operated (step S14; NO),the process proceeds to step S11.

If the freeze button is operated (step S14; YES), the cine slidergenerating unit 18 executes the cine slider generation process (stepS15). Here, the cine slider generation process in step S15 will bedescribed with reference to FIG. 6. In the cine slider generating unit18, the cine video data is read out one frame by one frame and a cinemarker is given to each frame.

First, the cine slider generating unit 18 reads out the cine framehaving the smallest frame number in the cine video data which is not yetread out and the cine information corresponding to this cine frame fromthe cine storage unit 16 (step S31).

Thereafter, the cine slider generating unit 18 determines whether anabnormal candidate spot number is included in the cine information whichis read out in step S31 (step S32). If an abnormal candidate spot numberis included (step S32; YES), the cine slider generating unit 18 performsa post processing thereafter according to the abnormal candidate spotnumber. Here, description is given by assuming that the abnormalcandidate spot is a tumor.

The cine slider generating unit 18 calculates the radius of the abnormalcandidate spot (tumor radius) in the cine frame which is read out instep S31 (step S33). In step S33, a tumor which is the abnormalcandidate spot is detected in similar way as described in steps S21 toS23 of FIG. 4, and the tumor radius is obtained by extracting thecontour line of the tumor, for example.

Then, the cine slider generating unit 18 determines whether the tumorradius which is calculated in step S33 is the maximum radius (step S34).In step S34, whether the tumor radius is the maximum is determined ineach of the cine frames of the continuous cine frames (abnormalcandidate region) including the abnormal candidate spot, the continuouscine frames including the cine frame which is read out in step S31 justbefore this step. If it is determined that the tumor radius is themaximum radius (step S34; YES), the cine slider generating unit 18 makesthe frame number of the cine frame which is read out in step S31 and thecine marker number which indicates that the abnormal candidate spot(tumor) has the maximum radius be associated with each other (step S35).In step S35, the frame number of the cine frame which is read out instep S31 just before this step and the cine marker number indicatingthat the tumor has the maximum radius are made to be associated witheach other and at the same time, the association between the framenumber and the cine marker number indicating that the tumor has themaximum radius in the abnormal candidate region including the cine framewhich is read out in step S31 just before this step is canceled, and theframe number whose association is canceled and the cine marker numberwhich indicates the abnormal candidate region are made to be associatedwith each other.

If the tumor does not have the maximum radius (step S34; NO), the cineslider generating unit 18 makes the frame number of the cine frame whichis read out in step S31 and the cine marker number which indicates theabnormal candidate (tumor) region be associated with each other (stepS36). If there is no abnormal candidate spot number (step S32; NO), thecine slider generating unit 18 makes the frame number of the cine framewhich is read out in step S31 and the cine marker number of the normalregion be associated with each other (step S37).

After executing steps S35, S36 and S37, the cine slider generating unit18 determines whether the cine frame which is read out in step S31 justbefore this step is the last frame of the cine video data (step S38). Ifit is not the last frame (step S38; NO), the process proceeds to stepS31. If it is the last frame (step S38; YES), the cine slider generatingunit 18 reads out the marker information of the marker corresponding tothe cine marker number which indicates that the tumor has the maximumradius and the marker information of the abnormal candidate region whichcorresponds to the cine marker number indicating the abnormal candidateregion from the cine marker storage unit 17 as needed. Then, the cineslider generating unit 18 generates a cine slider on the basis of theabove read out marker information and the association information ofsteps S35, S36 and S37 (step S39) and ends the cine slider generationprocess.

After the cine slider generation process, as shown in FIG. 3, thedisplay composite unit 19 performs the cine screen information display(step S16). The display composite unit 19 displays the cine video datawhich is read out from the cine storage unit 16 and the cine sliderwhich is generated in the cine slider generating unit 18 in the display20.

Here, an example of cine screen information which is to be displayed inthe display unit 20 in step S16 will be described with reference to FIG.7.

As shown in FIG. 7, the cine screen 200 as cine screen informationincludes the ultrasound image part 210 and the cine slider part 220. Theultrasound image part 210 is a region where an ultrasound image of acine frame in the cine video data which is obtained and stored in stepsS11 to S14 is displayed. In the ultrasound image part 210 of FIG. 7, theultrasound image is not shown. The cine slider part 220 is a regionwhere information corresponding to the cine frame which is beingdisplayed in the ultrasound image part 210 and the cine video datathereof is displayed in terms of a cine slider.

The cine slider part 220 includes the image position display part 221,the cine slider 222, the abnormal candidate region 223 and the marker224. The marker 225 will be described later.

The image position display part 221 is a display element which indicatesthe position in the display order of the cine frame which is beingdisplayed in the ultrasound image part 210 in the cine video data whichis obtained and stored in steps S11 to S14 in terms of number. In FIG.7, it is indicated that the cine frame of the ultrasound image which isbeing displayed in the ultrasound image part 210 is the 125th cine framein the display order (which is the 125th generated) among the total of125 frames in the cine video data.

The cine slider 222 is a slide bar indicating the position of the cineframe which is being displayed in the ultrasound image part 210. Thecine slider 222 indicates the display order of the cine frame which isbeing displayed in the ultrasound image part 210 among all of the framesin the cine video data which is obtained and stored in steps S11 to S14by the slider's position on the bar, whether it is on the right or onthe left on the bar. The cine slider 222 includes a nob 222 a whichindicates the position of the cine frame which is being displayed in theultrasound image part 210 and which can be moved in the left and rightdirections to be input (operated).

The abnormal candidate region 223 is a cine marker as a display elementto indicate the position of the abnormal candidate region on the cineslider 222, the abnormal candidate region being a range over a pluralityof continuous cine frames where a tumor is detected as an abnormalcandidate spot. In such way, if one abnormal candidate spot exists overthe range of a plurality of frames, the abnormal candidate region 223 isdisplayed on the cine slider 222 so that the range can be visuallyrecognized.

A (upside down triangle) marker is a cine marker as a display element toindicate the position of the cine frame in which the abnormal candidatespot is detected on the cine slider 222. In the embodiment, the marker224 indicates the position where the maximum radius of the tumor isdepicted in the image data in which the tumor is detected as theabnormal candidate spot. Preferably, the display composite unit 19 setsthe marker and the abnormal candidate region of the same abnormalcandidate spot be in the same color according to the type of theabnormal candidate spot.

The marker 224 is not displayed with respect to all of the cine framesrelating to the abnormal candidate region 223 and is displayed withrespect to one unique cine frame among all of the cine frames relatingto the abnormal candidate region 223. Here, the marker 224 is displayedat the position corresponding to the cine frame in which the tumor hasthe maximum radius among all of the cine frames relating to the abnormalcandidate region 223. That is, the marker 224 and the abnormal candidateregion 223 are displayed at the cine frame position having the framenumber which is made to be associated with the cine marker numberindicating that the tumor has the maximum radius in step S35. Further,the abnormal candidate region 223 is displayed at the cine frameposition having the frame number which is made to be associated with thecine marker number indicating the abnormal candidate region in step S36.However, display of the markers is not limited to the display asdescribed above. In the case where the cine frame having the framenumber which is made to be associated with the cine marker numberindicating that the tumor has the maximum radius is not a continuationof other cine frames relating to the abnormal candidate spot, only themarker may be displayed at the cine frame position having the framenumber which is made to be associated with the cine marker numberindicating that the tumor has the maximum radius.

Nothing is displayed at the cine frame position having the frame numberwhich is made to be associated with the cine marker number indicatingthe normal region in step S37. However, this is not limitative in anyway. A cine marker as a display element of a region indicating thenormal region or the like may be displayed at the cine frame positionhaving the frame number which is made to be associated with the cinemarker number indicating the normal region.

Further, a marker may be set at the position corresponding to one cineframe relating to the abnormal candidate region being associated withother feature of the abnormal candidate spot (such as, an abnormalcandidate spot is detected and also an examiner has manipulated at thetime when the cine frame was generated).

In the cine screen information display in step S16, the cine frames ofthe cine video data are replayed and displayed in the order from thecine frame having the first frame number to the cine frame having thelast frame number with a predetermined time interval therebetween, forexample. At this time, the cine frame to be displayed in the ultrasoundimage part 210 is sequentially switched and the nob 222 a of the slider22 also moves to the right direction accordingly.

Next, the second cine screen information display process will bedescribed with reference to FIG. 8. The second cine screen informationdisplay process is a process in which, after cine video data isgenerated and stored, an abnormal candidate spot such as a leisure isdetected in the cine frames of the cine video data, the cine video datais displayed along with the cine slider which indicates the cine framein which the abnormal candidate spot exists. Here, an example ofabnormal candidate spot detection where the leisure is a tumor will alsobe described.

It is assumed that the process similar to steps S11 and S12 of FIG. 3 isrepeatedly executed to generate cine video data and the generated cinevideo data is stored in the cine storage unit 16 in advance. Forexample, input of the instruction to execute the second cine screeninformation display process performed by an examiner of a subject viathe operation input unit 11 being the trigger, the controller 21controls the individual parts in accordance with the second cine screeninformation display program which is stored in the ROM and executes thesecond cine screen information display process.

As shown in FIG. 8, first, the cine information generating unit 15 readsout one cine frame whose frame number is the smallest number, which isnot yet read out from the cine video data, from the cine storage unit 16(step S41). Steps S42 to 946 are similar to step S21 to S25 in FIG. 4,and the cine frame which is the target frame from which an abnormalcandidate spot is detected is the cine frame which is read out in stepS41.

Then, the cine information generating unit 15 determines whether thecine frame which is read out in step S41 just before this step is thelast frame of the cine video data (step S47). If the cine frame is notthe last frame (step 947; NO), the process proceeds to step S41. If thecine frame is the last frame (step S47; YES), the cine slider generatingunit 18 executes step S48 and the display composite unit 19 executesstep S49, and thereby, ends the second cine screen information displayprocess. Steps S48 and S49 are similar to the process of steps S15 andS16 in FIG. 3.

In the above described first and second cine screen information displayprocesses, a tumor as an abnormal candidate spot is detected in a cineframe. However, this is not limitative in any way. In the first andsecond cine screen information display process, other type of abnormalcandidate spot such as a calcification, breast duct observation, fattydeposit, other lesion or the like may be detected. Further, two types ormore of abnormal candidate spots may also be detected.

For example, in step S23 of FIG. 4, an abnormal candidate spot of acalcification, breast duct observation or a fatty deposit is detected.In steps S24 and S25, the type of abnormal candidate spot (fattydeposit) and the thickness thereof are made to be associated with theframe number of the cine frame in which the abnormal candidate spot isdetected to be included in the cine information.

In step S15 of FIG. 3, a cine marker is arranged on the cine slideraccording to the marker information corresponding to the type ofabnormal candidate spot in the cine information such as a calcification,breast duct observation or a fatty deposit. For example, in the casewhere the type of abnormal candidate spot is a calcification, the cinemarker indicating a calcification can be arranged at the position of anyone cine frame relating to the abnormal candidate region, which is acalcification, in step S35. In the case where the type of abnormalcandidate spot is breast duct observation, the cine marker indicatingbreast duct observation can be arranged at the position of the firstcine frame relating to the abnormal candidate region, which is breastduct observation, in step S35. In the case where the type of abnormalcandidate spot is a fatty deposit, the thickness thereof is calculatedin step S33 and the cine marker indicating a fatty deposit can bearranged at the position of one cine frame which depicts the fattydeposit having the maximum thickness among the cine frames relating tothe abnormal candidate region, which is a fatty deposit, in step S35.The above described arrangement of cine markers are merely examples andis not limitative in any way. For example, the cine marker indicating atumor may be arranged at the position of the first cine frame, the cineframe at the center or the last cine frame relating to the abnormalcandidate region indicating a tumor.

Further, in the first and second cine screen information displayprocesses, a cine marker and an abnormal candidate region may bedisplayed on the cine slider in correspondence to the operatinginformation which is input by an examiner operating on the operationinput unit 11 at the time when the cine frames of cine video data aregenerated. For example, if an operation input is performed during a loopof steps S11 to S14 of FIG. 3 (generation and storage of one cineframe), the type of operating information relating to the operationinput is made to be associated with the frame number of the cine framewhich is generated just before to be included in the cine information insteps S24 and S25 of FIG. 4.

Then, in step S15 of FIG. 3, a cine marker is arranged on the cineslider according to the marker information corresponding to the type ofoperating information in the cine information. For example, in the casewhere the type of operating information is still image storage, the cinemarker indicating the relevant operation is arranged at the position ofthe corresponding cine frame. For example, the marker 225 relating tothe operation (still image storage) is displayed in the cine screen 200of FIG. 7. The type of operating information is not limited to stillimage storage, and other types such as printing instruction of the cineframe which is being displayed (not shown in the drawing) to a printerand the like may be applied.

In the second cine screen information display process, generating andstoring of cine video data is executed, operating informationcorresponding to an operation input performed at the time of generatingof each frame of the cine video data is obtained and the cine video dataand the operating information of individual frames are stored in thecine storage unit 16 in the ultrasound diagnostic imaging apparatus 100in advance. In steps S45 and S46, cine information is generatedaccording to the operating information of individual frames stored inthe cine storage unit 16 and the generated cine information is stored inthe cine storage unit 16.

With respect to markers, in the case where a plurality of markers arearranged at the same position on the cine slider 222, they can bearranged vertically with respect to the longitudinal direction(chronological order direction) of the cine slider 222 as in the case ofthe markers 224 and 225.

Further, an operation region corresponding to a plurality of continuouscine frames may be displayed on the cine slider 222 according to thetype of operating information. With respect to the operation region, theposition of the marker indicating an operation is set at one positionwhich is the cine frame position of the first frame in the operationregion, which is the first in the generation order. However, this is notlimitative in any way. The marker indicating an operation may be set atone position such as at the last or at the center in the operationregion according to the generation order. Further, it is preferred thatthe abnormal candidate spot or the marker indicating an operation isarranged at one position in the abnormal candidate region or in theoperation region. However, a plurality of abnormal candidate spots ormarkers indication operations may be arranged.

Moreover, it is preferred that different types of markers are displayedin different colors. For example, in the cine screen 200, the marker 225corresponding to an operation (still image storage) and the marker 224corresponding to an abnormal candidate spot which is a tumor aredisplayed in different colors. According to two types or more ofabnormal candidate spots, various types of markers may be displayed indifferent colors. According to two types or more of operations, varioustypes of markers may be displayed in different colors.

As described above, according to the embodiment, the ultrasounddiagnostic imaging apparatus 100 includes the cine informationgenerating unit 15 which extracts a structural object in an ultrasoundimage of each cine frame from cine video data, detects an abnormalcandidate spot in the extracted structural object, and generates cineinformation where the detected abnormal candidate spot is made to beassociated with the cine frame in which the abnormal candidate spot isdetected.

Thus, the position of the cine frame in which the detected abnormalcandidate spot exists can be displayed by using the generated cineinformation. Therefore, where in the cine video data is the cine framein which the abnormal candidate spot exists can easily be visuallyrecognized by a reader. Further, the abnormal candidate spot in the cinevideo data can be detected automatically and burden on a reader and anexaminer can be reduced.

The ultrasound diagnostic imaging apparatus 100 further includes thecine slider generating unit 18 which generates a cine slider byarranging the marker information (marker 224) corresponding to the typeof abnormal candidate spot in the generated cine information at theposition of the frame in which the abnormal candidate spot is detectedand the display composite unit 19 which makes the cine video datadisplay in the display 20 with the generated cine slider. Thus, sincethe position of the cine frame in which the detected abnormal candidatespot exists can be shown on the cine slider by a marker, where in thecine video data is the cine frame in which the abnormal candidate spotexists can easily be visually recognized by a reader.

Further, in the case where a region of a plurality of continuous framesrelating to the same type of abnormal candidate spot exists in the cinevideo data, the cine slider generating unit 18 generates a cine sliderby arranging the marker information (abnormal candidate region 223)which indicates the abnormal candidate region of the abnormal candidatespot at the abnormal candidate region. Thus, the range of a plurality offrames relating to the same type of abnormal candidate spot can easilybe visually recognized by a reader.

Further, the cine slider generating unit 18 generates a cine slider bysetting the one cine frame where the marker information (marker 224)corresponding to the type of abnormal candidate spot is to be displayedin the abnormal candidate region of the abnormal candidate spot anddisposing the marker information at the position of the set cine frame.Thus, since a marker can be displayed on the cine slider at the positioncorresponding to one cine frame in the abnormal candidate region,visually confused state due to a plurality of cine markers relating tothe same type of abnormal candidate spot being displayed can beprevented.

The cine slider generating unit 18 further generates a cine slider wherethe marker information of the abnormal candidate spot and the abnormalcandidate region are set to be displayed in different colors accordingto the types of abnormal candidate spot. Thus, since cine markers andabnormal candidate regions of different colors can be displayedaccording to the types of abnormal candidate spot, the difference in thetype of abnormal candidate spot can easily be visually recognized by areader.

Further, the cine information generating unit 15 generates cineinformation including operating information where the operation typewhich is carried out during generation of the cine video data is made tobe associated with the cine frame which was subject to the operation.Thus, since the position of the cine frame to which the operation wasperformed at the time of generation can be displayed by using thegenerated cine information, where in the cine video data is the cineframe to which the operation was performed at the time of generation caneasily be visually recognized by a reader. Further, the cine frame whichwas subject to the operation (to which the operation was performed atthe time of generation) in the cine video data can be detectedautomatically and the burden on a reader and an examiner can be reduced.

Moreover, the cine slider generating unit 18 generates a cine slider byobtaining the marker information (marker 225) corresponding to theoperation type indicated in the generated cine information from the cinemarker storage unit 17 and by arranging a marker indicating theoperation at the position of the cine frame which is subject to theoperation. Thus, since the position of the cine frame which is subjectto the operation can be displayed on the cine slider by a marker, wherein the cine video data is the cine frame which is subject to theoperation can easily be visually recognized by a reader.

Modification Example

A modification example of the above embodiment will be described withreference to FIGS. 9 and 10. FIG. 9 is the block diagram showing theultrasound diagnostic imaging system 1000. FIG. 10 is the flowchart ofthe third cine screen information display process.

As shown in FIG. 9, the ultrasound diagnostic imaging system 1000 of themodification example includes an ultrasound diagnostic imaging apparatus100A and an ultrasound image processing apparatus 300. The ultrasounddiagnostic imaging apparatus 100A includes the configuration componentsthat are similar to those of the ultrasound diagnostic imaging apparatus100 of the embodiment (not shown in the drawing) and further includes acommunication unit 22 which is connected to the controller 21.

The communication unit 22 is formed of a communication unit of a wiredcommunication such as via a LAN (Local Area Network) using a cable or anon-wire communication. The communication unit 21 performs communicationwith the ultrasound image processing apparatus 300.

The ultrasound image processing apparatus 300 includes a controller 31,an operation input unit 32, a storage unit 33, a display 34 and acommunication unit 35. The controller 31 includes a CPU and a RAM. TheCPU of the controller 31 reads out a program stored in the storage unit33, opens the program in the RAM and executes the process in cooperationwith the opened program. In such way, the CPU of the controller 31executes various types of processes in cooperation with the programs.

The operation input unit 32 is formed of a keyboard and a pointingdevice such as a mouse. The operation input unit 32 receives anoperation input performed by an operator and outputs the operatinginformation to the controller 31. The storage unit 33 is formed of a HDD(Hard Disk Drive), a SSD (Solid State Drive) or the like, and varioustypes of data and programs are stored in the storage unit 33. It isassumed that the third cine screen information display program andmarker information corresponding to the abnormal candidate spot typesare stored in the storage unit 33.

The display 34 is a display apparatus such as a CRT display, an organicEL display, an inorganic EL display, a plasma display or the like. Thecommunication unit 35 is formed of a communication unit of thecommunication method corresponding to the communication unit 22, andperforms communication with the ultrasound diagnostic imaging apparatus100A.

Next, operation of the ultrasound diagnostic imaging system 1000 will bedescribed with reference to FIG. 10. Here, an example where a marker andan abnormal candidate region corresponding to an abnormal candidate spotare displayed will be described.

It is assumed that the process similar to steps S11 and S12 of FIG. 3 isrepeatedly executed to generate cine video data and store the generatedcine video data in the cine storage unit 16 in advance in the ultrasounddiagnostic imaging apparatus 100A. The controller 31 of the ultrasoundimage processing apparatus 300 sends a request for cine video data tothe ultrasound diagnostic imaging apparatus 100A via the communicationunit 35 in accordance with the input of the instruction to obtain thecine video data performed by an operator on the operation input unit 32.The controller 21 of the ultrasound diagnostic imaging apparatus 100Areceives the above request via the communication unit 22, reads out thecine video data corresponding to the request from the cine storage unit16, and sends the cine video data to the ultrasound image processingapparatus 300 via the communication unit 22. The controller 31 of theultrasound image processing apparatus 300 receives the cine video datafrom the ultrasound diagnostic imaging apparatus 100A via thecommunication unit 35 and stores the cine video data in the storage unit33.

For example, input of the instruction to execute the third cine screeninformation display process made by an operator via the operation inputunit 32 being the trigger, the CPU of the controller 31 reads out thethird cine screen information display program which is stored in theROM, opens the program in the RAM and executes the third cine screeninformation generation process in cooperation with the opened program.

As shown in FIG. 10, the controller 31 executes steps S51 to S59 andends the third cine screen information display process. Steps S51 to S59are the process which is similar to that of steps S41 to S49 of FIG. 8.Here, the processes in the modification example corresponding to theprocesses performed by the cine information generating unit 15, the cineslider generating unit 18 and the display composite unit 19 in FIG. 8are performed by the controller 31, the information in the modificationexample corresponding to the information stored in the cine storage unit16 and the cine marker storage unit 17 in FIG. 8 is stored in storageunit 33, and the display 20 in FIG. 2 corresponds to the display 34 ofthe modification example.

By the third cine screen information display process, cine video dataand cine information are stored in the storage unit 33. The controller31 may read out the cine video data and the cine information stored inthe storage unit 33 and send them to the ultrasound diagnostic imagingapparatus 100A via the communication unit 35. In such case, thecontroller 21 of the ultrasound diagnostic imaging apparatus 100Areceives the cine video data and the cine information from theultrasound image processing apparatus 300 via the communication unit 22and stores them in the cine storage unit 16. Similarly to steps S38 andS39 in the second cine screen information display process of FIG. 8, thecontroller 21 generates cine screen information with the cine video dataand the cine information stored in the storage unit 33 and displays thegenerated cine screen information in the display 20. In the modificationexample, similarly to the above described embodiment, a cine slider onwhich a marker indicating an operation and an operation region arearranged may also be generated.

As described above, according to the modification example, theultrasound image processing apparatus 300 includes the controller 31which extracts a structural object in the ultrasound image of each cineframe from the cine video data, detects an abnormal candidate spot inthe extracted structural object, and generates cine information wherethe detected abnormal candidate spot is made to be associated with thecine frame in which the abnormal candidate spot is detected.

Thus, the position of the cine frame in which the detected abnormalcandidate spot exists can be displayed by using the generated cineinformation. Therefore, where in the cine video data is the cine framein which the abnormal candidate spot exists can easily be visuallyrecognized by a reader. Further, the abnormal candidate spot in the cinevideo data can be detected automatically and the burden on a reader andan examiner can be reduced. Further, by the third cine screeninformation generation process is being executed in the ultrasound imageprocessing apparatus 300, the amount of computation performed in theultrasound diagnostic imaging apparatus 100A for performing ultrasounddiagnosis can be reduced.

In the above description, an example where the ROM is used as a computerreadable medium of a program according to the present invention isshown. However, this is not limitative in any way. As other computerreadable media, a non-volatile memory such as a flash memory, a portablerecording medium such as a CD-ROM, etc. can be used. Further, as amedium which provides data of programs relating to the present inventionvia a communication circuit, carrier wave can also be used.

The above descriptions of the embodiment and the modification exampleare merely examples of the preferred ultrasound image processingapparatus according to the present invention and a computer readablemedium in which programs are realized, and these examples are notlimitative in any way.

For example, in the above described embodiment and modification example,cine video data and cine information are separate data. However, this isnot limitative in any way. Cine information may be included in cinevideo data (clue frame) as attached information such as tag information.

Further, in the above described embodiment and modification example, acine screen 200 includes the ultrasound image part 210 for oneultrasound image and the cine slider part 220 is displayed as shown inFIG. 7. However, this is not limitative in any way. For example, thecine screen 200 may include thumbnails of a predetermined number of cineframes in the front and behind the cine frame shown in the ultrasoundimage part 210, in the order of generation, separately from theultrasound image part 210. Further, if the cine marker and the same typerange part correspond to the image data of these thumb nails, inaddition to the cine slider, cine markers and the same type range partmay be displayed so as to be associated with the thumb nails.

Moreover, in the above described embodiment and modification example,the ultrasound image data to be generated is B mode image data. However,this is not limitative in any way. The ultrasound image data to begenerated may be volume data as three dimensional data or the like.

With respect to the ultrasound diagnostic imaging apparatus 100 and theultrasound diagnostic imaging system 1000 in the above embodiment,detail configuration and detail operation of the components thereof maybe modified as needed within the gist of the present invention.

The entire disclosure of Japanese Patent Application No. 2015-144139filed on Jul. 21, 2015 is incorporated herein by reference in itsentirety.

What is claimed is:
 1. An ultrasound image processing apparatus,comprising: a structural object extracting unit which extracts astructural object in an ultrasound image of each frame from ultrasoundimage data of a plurality of continuous frames; an abnormal candidatespot detecting unit which detects an abnormal candidate spot in theextracted structural object; a cine information generating unit whichgenerates cine information in which the detected abnormal candidate spotis made to be associated with one or more frames in which the abnormalcandidate spot is detected, from among the plurality of frames ofultrasound image data; and a cine slider generating unit whichgenerates, based on the cine information, a cine slider which includes afirst marker indicating an abnormal candidate region corresponding tothe one or more frames in which the abnormal candidate spot is detected,and a second marker indicating a frame, in the abnormal candidateregion, in which the abnormal candidate spot is depicted with a maximumradius.
 2. The ultrasound image processing apparatus of claim 1, whereinthe cine slider is operable to receive an operation to slide and displaythe plurality of frames of ultrasound image data; wherein the firstmarker and the second marker include information indicating a type ofthe abnormal candidate spot; wherein the cine slider generating unitgenerates the cine slider such that the first marker is arranged at aposition on the cine slider corresponding to the abnormal candidateregion, and the second marker is arranged at a position on the cineslider corresponding to the frame in the abnormal candidate region inwhich the abnormal candidate spot is depicted with the maximum radius;and wherein the ultrasound image processing apparatus further comprisesa display controller which makes the plurality of frames of ultrasoundimage data be displayed in a display with the generated cine slider. 3.The ultrasound image processing apparatus of claim 2, wherein, in a casewhere a plurality of continuous frames relating to a same type ofabnormal candidate spot exist in the plurality of frames of ultrasoundimage data, the cine slider generating unit generates the cine slider byarranging the first marker which indicates the abnormal candidate regionof the plurality of frames relating to the same type of abnormalcandidate spot in the generated cine information at a position on thecine slider corresponding to the abnormal candidate region correspondingto the plurality of frames relating to the same type of the abnormalcandidate spot.
 4. The ultrasound image processing apparatus of claim 3,wherein the cine slider generating unit generates the cine slider bysetting one frame for displaying the second marker corresponding to thetype of abnormal candidate spot in the abnormal candidate regionrelating to the same type of abnormal candidate spot, and by arrangingthe second marker at a position of the set frame on the cine sider. 5.The ultrasound image processing apparatus of claim 3, wherein the cineslider generating unit generates the cine slider by setting differentcolors according to types of abnormal candidate spot to display thefirst marker indicating the abnormal candidate region and/or the secondmarker relating to the same type of abnormal candidate spot as the firstmarker.
 6. The ultrasound image processing apparatus of claim 1, whereinthe cine information generating unit generates the cine informationincluding operating information where a type of operation performed whengenerating the plurality of frames of ultrasound image data is made tobe associated with a frame which is subject to the operation.
 7. Theultrasound image processing apparatus of claim 2, wherein: the cineinformation generating unit generates the cine information includingoperating information where a type of operation performed whengenerating the plurality of frames of ultrasound image data is made tobe associated with a frame which is subject to the operation, and thecine slider generating unit generates the cine slider by arranging athird marker corresponding to the type of operation in the generatedcine information at a position of a frame which is subject to theoperation.
 8. The ultrasound image processing apparatus of claim 1,further comprising: a transmitting unit which transmits a driving signalto an ultrasound prove which transmits and receives ultrasound waves toand from a subject; a receiving unit which receives a received signalfrom the ultrasound probe; and an image generating unit whichsequentially generates the plurality of frames of image data from thereceived signal.
 9. The ultrasound image processing apparatus of claim1, wherein the abnormal candidate spot detecting unit detects a tumor asthe abnormal candidate spot, and wherein the second marker indicates theframe, in the abnormal candidate region, in which the tumor is depictedwith a maximum radius.
 10. A computer readable non-transitory mediumwhich realizes a program to make a computer function as: a structuralobject extraction unit which extracts a structural object in anultrasound image of each frame from ultrasound image data of a pluralityof continuous frames; an abnormal candidate spot detecting unit whichdetects an abnormal candidate spot in the extracted structural object; acine information generating unit which generates cine information inwhich the detected abnormal candidate spot is made to be associated withone or more frames in which the abnormal candidate spot is detected,from among the plurality of frames of ultrasound image data; and a cineslider generating unit which generates, based on the cine information, acine slider which includes a first marker indicating an abnormalcandidate region corresponding to the one or more frames in which theabnormal candidate spot is detected, and a second marker indicating aframe, in the abnormal candidate region, in which the abnormal candidatespot is depicted with a maximum radius.
 11. The computer readablenon-transitory medium of claim 10, wherein the abnormal candidate spotdetecting unit detects a tumor as the abnormal candidate spot, andwherein the second marker indicates the frame, in the abnormal candidateregion, in which the tumor is depicted with a maximum radius.
 12. Anultrasound image processing apparatus, comprising: a display which isconfigured to display a plurality of continuous frames of ultrasoundimage data; and a hardware circuit which is configured to: extract astructural object in an ultrasound image of each frame from ultrasoundimage data of the plurality of continuous frames, detect an abnormalcandidate spot in the extracted structural object, generate cineinformation in which the detected abnormal candidate spot is made to beassociated with one or more frames in which the abnormal candidate spotis detected, from among the plurality of frames of ultrasound imagedata; and generate, based on the cine information, a cine slider whichincludes a first marker indicating an abnormal candidate regioncorresponding to the one or more frames in which the abnormal candidatespot is detected, and a second marker indicating a frame, in theabnormal candidate region, in which the abnormal candidate spot isdepicted with a maximum radius.
 13. The ultrasound image processingapparatus of claim 12, wherein the hardware circuit detects a tumor asthe abnormal candidate spot, and wherein the second marker indicates theframe, in the abnormal candidate region, in which the tumor is depictedwith a maximum radius.